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ABSTRACT 

An interpolation-based method, such as bilinear, 
bicubic, or nearest neighbor interpolation, is regarded 
as a simple way to increase the spatial resolution for 
the LR image. It uses the interpolation kernel to 
predict the missing pixel values, which fails to 
approximate the underlying image structure and leads 
to some blurred edges. In this work a super resolution 
technique based on Sparse characteristics of wavelet 
transform. Hence, we proposed a wavelet based 
super-resolution technique, which will be of the 
category of interpolative methods, using sparse 
property of wavelets. It is based on sparse 
representation property of the wavelets. Simulation 
results prove that the proposed wavelet based 
interpolation method outperforms all other existing 
methods for single image super resolution. The 
proposed method has 7.7 dB improvement in PSNR 
compared with Adaptive sparse representation and 
self-learning ASR-SL [1] for test image Leaves, 12.92 
dB improvement for test image Mountain Lion & 7.15 
dB improvement for test image Hat compared with 
ASR-SL [1], Similarly, 12% improvement in SSIM 
for test image Leaves compared with [1], 29% 
improvement in SSIM for test image Mountain Lion 
compared with [1] & 17% improvement in SSIM for 
test image Hat compared with [1], 

Keyword: Super Resolution, Image Reconstruction, 
Single Image Resolution Techniques, Resolution 
Enhancement, Wavelet transform, Interpolation. 

1. INTRODUCTION 

Image super resolution is an image processing 
algorithms that produce high quality, high resolution 
(HR) images from a set of low quality, low resolution 


(LR) images or from a single image. The SR image 
reconstruction is useful in many practical cases where 
multiple frames of the same scene can be obtained; 
including medical imaging, satellite imaging, and 
video applications [17].The basic premise for 
increasing the spatial resolution in SR techniques is 
the availability of multiple LR images captured from 
the same scene. The set of source low resolution (LR) 
images captures only a finite amount of information 
from a scene; the goal of SR is to extract the 
independent information from each image in that set 
and combine the information into a single high 
resolution (HR) image. The requirement is of SR is 
that each LR image must contain some information 
that is unique to that image [3]. The super resolution 
method is to take more samples of the scene so as to 
get some extra information which can be used, while 
merging the samples to get a high resolution image. 
These samples can be acquired by sub-pixel shifts, by 
changing scene , by changing the amount of blur [14] 
.HR means that pixel density within an image is high, 
and therefore an HR image can offer more details that 
are important in many applications. The major 
advantage of the super resolution approach is that it 
may cost less and the existing LR imaging systems 
can be still utilized. Synthetic zooming of region of 
interest (ROI) is another important application in 
surveillance, forensic, scientific, medical, and satellite 
imaging [13], This application is most suitable for 
magnifying objects in the scene such as the face of a 
criminal or the license plate of a car [16], 
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Figure 1: Classification of Super Resolution 
Techniques 


2. VARIOUS EXISTING SUPER¬ 
RESOLUTION TECHNIQUES 

2.1 SR using compressive sensing based on a 
redundant dictionary 

1. Y. Sun Et-al, presented a compressive sensing 
based on a redundant dictionary has been successfully 
applied in super resolution imaging. However, due to 
the neglect of the local and nonlocal interactions of 
patches of a single image, the reconstructed results are 
not satisfactory in noise suppression and edge 
sharpness. In this paper, we propose an improved 
method by adding steering kernel regression and a 
nonlocal means filter as two regularization terms and 
use an efficient clustering sub-dictionary learning 
scheme. We further demonstrate better results on true 
images in terms of traditional image quality 
assessment metrics. 

2.2 SR reconstruction based on the compressive 
sensing 

2. Y. Sun Et-al, presented an observation for 
medical imaging and astronomical, high-resolution 
(HR) images are urgently desired and required. In 
recent years, many researchers have proposed various 
ways to achieve the goal of image super-resolution 
(SR), ranging from simple linear interpolation 
schemes to nonlinear complex methods. In this paper, 
we deal with the SR reconstruction problem based on 
the theory of compressive sensing, which uses a 
redundant dictionary instead of a conventional 
orthogonal basis. We further demonstrate better 
results on true images in terms of peak signal-to-noise 
ratio (PSNR) and root mean-square error (RMSE) and 
give several important improvements, compared with 
other methods. 


Although wide variety of super-resolution literature is 
available, it is still an open topic to investigate. 
Following subsections describe some of the existing 
basic image super-resolution schemes. 

2.3 SR via Sparse Representation 

Jianchao Yang et al. [9] considered the sparse signal 
representation of an image. Based on previous 
research on image statistics the image patches can be 
well-represented as a sparse linear combination of 
elements from an appropriately chosen over-complete 
dictionary. Motivated by this, they proposed a sparse 
representation for each patch of the low-resolution 
input. The coefficients of this representation are used 
to generate the high-resolution output. Theoretical 
results from compressed sensing suggest that the 
sparse representation can be correctly recovered from 
the down-sampled signals under mild conditions. 

Similarity of sparse representations between the 
low-resolution and high-resolution image patch pair 
with respect to their own dictionaries is enforced, by 
jointly training two dictionaries for the low and high- 
resolution image patches. So, the sparse 
representation of a low-resolution image patch is 
being applied with the high-resolution image patch 
dictionary to generate a high-resolution image patch. 
They showed the effectiveness of such a sparsity prior 
for both general image super-resolution (SR) and the 
special case of face hallucination. This algorithm can 
handle SR with noisy inputs in a more unified 
framework because the local sparse modeling is 
naturally robust to noise. 

2.4 Nonlinear Mapping of Coherent Features 

Xiao Zeng and Hua Huang presented a regression 
based method that can successfully recognize the 
identity given all these difficulties. They built a radial 
basis function in subspace by canonical correlation 
analysis to nonlinear regression models from the 
specific non frontal low resolution image to frontal 
high resolution features. 

2.5 Geometric Grouplets 

A. Maalouf and M. C. Larabi proposed the idea of 
generating a super-resolution (SR) image from a 
single multi-valued low-resolution (LR) input image. 
This problem approaches from the perspective of 
image geometry-oriented interpolation. They 
computed the group let transform to obtain geometry 
of the LR image. Geometric group lets is constructed 
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by orthogonal multiscale grouping with weighted 
Haar lifting to points grouped by association fields. 

To preserve the sharpness of edges and textures SR 
image is synthesised by an adaptive directional 
interpolation using the extracted geometric 
information. This method showed improvements over 
existing geometrically driven interpolation techniques 
on a subjective scale, and in many cases with an 
improvement in psycho visual color difference. 


2.6 


2.7 


resolution image without any external training set. 
They proposed a framework for both magnification 
and deblurring using only the original low-resolution 
image and its blurred version. In This method, each 
pixel is predicted by its neighbors through the 
Gaussian process regression. 


Remotely Sensed image by Hope field 
Neural Network 

J Tatem Andrew et al. [12] used their idea of super¬ 
resolution for target identification in remotely sensed 
images. Fuzzy classification improves the accuracy of 
land cover target identification make robust and better 
for spatial representation of land cover. The Hopfield 
neural network converges to a minimum of an energy 
function, defined as a goal and several constraints. 
The energy minimum represents a best guess map of 
the spatial distribution of class components in each 
pixel. 


They showed that, by using a proper covariance 
function, the Gaussian process regression can perform 
soft clustering of pixels based on their local 
structures. This algorithm can extract adequate 
information contained in a single low-resolution 
image to generate a high-resolution image with sharp 
edges. Compared to other edge-directed and example- 
based super-resolution algorithms this algorithm is 
superior in quality and performance. 


2.9 


They used two goal functions to make the output of a 
neuron similar to that of its neighboring neurons. The 
first goal function aims to increase the output of 
center neuron to 1. The second goal function aims to 
decrease the output of the center neuron to 0. They 
showed that, by using a Hopfield neural network, 
more accurate measures of land cover targets can be 
obtained compared with those determined using the 
proportion images alone. 


Learning-based SR with a combining of 
both global and local constraints 

K. Guoet al. [15] proposed a statistical learning 
method for SR with both global and local constraints. 
More specifically, they introduced a mixture model 
into maximum a posteriori (MAP) estimation, which 
combines a global parametric constraint with a patch- 
based local non-parametric constraint. 


The global parametric constraint guarantees the super- 
resolved global image to agree with the sparse 
property of natural images, and the local non- 
parametric constraint is used to infer the residues 
between the image derived from the global constraint 
and the ground truth high-resolution (HR) image. 


Neural Network based Optimal Recovery 
Theory 

Yizhen Huang and YangjingLong [13] proposed 
Motivated by the idea that back propagation neural 
network are capable of learning complex nonlinear 
function they proposed a neural network approach 
that produces better results in high-frequency regions. 
They integrated an optimal recovery based approach 
with in a neural network framework and, if so, two 
different branches of algorithms complement each 
other to offer a better algorithm. Using this algorithm 
in a two-pass way generates visual results that are 
very similar regardless of the initial interpolation step, 
and more times of iteration only waste the computing 
resource but yield negligible performance gain. 


They compared it with traditional patch-based 
learning methods without the global constraint, and 
a staptMdhatrdaiwmgimidareiiHal-MBljvprksSnpsigRi&adlution al 
image structure, but also restore the local details more 
effectively. 


2.8 Gaussian Process Regression 

Wan-Chi Siu et-al, [14] addressed the problem of 
producing a high-resolution image from a single low- 


2.10 Interpolation based SR using Multi surface 
Fitting 

Fei Zhou et al. [16] proposed a interpolation-based 
method of image super-resolution reconstruction. 
They used the idea of multi surface fitting to take 
advantage of spatial structure information. Each site 
of low-resolution pixels is fitted with one surface, and 
the final estimation is made by fusing the 
multisampling values on these surfaces in the 
maximum a posteriori fashion. Figure 2 shows the 
flow chart of interpolation based SR using Multi 
surface Fitting. 
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2.12 SR by Complex Wavelet Transform 

Gholamreza Anbarjafari and Hasan Demirel [18] 
proposed a technique to enhance to resolution of 
satellite images based on interpolation of high- 
frequency subband images obtained by dual-tree 
complex wavelet transform (DT-CWT). This method 
uses DT-CWT to decompose an input low-resolution 
satellite image into different subband images and 
interpolates input images followed by combining all 
these images to generate high-resolution images by 
using inverse DT-CWT. Figure 4 shows the diagram 
of the method. 
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Figure 2: Flow chart of Multi surface Fitting 

For the final values of high intensity pixels they used 
maximum a posteriori estimation on sampled surface 
constructed using Taylor series. They showed that, 
this method reconstructs high-resolution images that 
preserve image details effectively without any 
hypothesis on image prior. They extended this method 
to a more general noise model. 
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Figure 4: Block diagram of DT-CWT SR 


2.11 SR Based on Interpolation of Wavelet 
Domain 

Gholamreza Anbarjafari and Hasan Demirel [17] 
proposed a super-resolution technique based on 
interpolation of the high-frequency sub band images 
obtained by discrete wavelet transform (DWT) and 
the input image. They used DWT to decompose an 
image into different subband images. Then the high- 
frequency subband images and the input low- 
resolution image have been interpolated, followed by 
combining all these images to generate a new super- 
resolved image by using inverse DWT. Figure 3 
shows the block diagram of the method proposed by 
Gholamreza Anbarjafari and Hasan Demirel. 


Interpolation with a factor a/2 



Figure 3: Block Diagram of DWT based SR 


2.13 Image Resolution Enhancement by using 
Discrete and Stationary Wavelet 
Decomposition 

Gholamreza Anbarjafari and Hasan Demirel [19] 
proposed a image resolution enhancement technique 
based on interpolation of the high frequency subband 
images obtained by discrete wavelet transform (DWT) 
and the input image. The edges are enhanced by 
introducing an intermediate stage by using stationary 
wavelet transform (SWT). DWT is applied in order to 
decompose an input image into different subbands. 
Then the high frequency subbands as well as the input 
image are interpolated. The estimated high frequency 
subbands are being modified by using high frequency 
subband obtained through SWT. Then all these 
subbands are combined to generate a new high 
resolution image by using inverse DWT (IDWT). 

3. PROPOSED METHODOLOGY 

An adaptive directional image interpolation is 
computed by estimating sparse image mixture models 
in a wavelet frame. This section describes a fast 
orthogonal block matching pursuit implementation. 
The detailed process of wavelet based super¬ 
resolution is, first the sub sampled image y(n) for is 
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decomposed with wavelet transform matrix xp whose 
columns are the vectors of a translation invariant 
wavelet frame xp d , m on a single scale (the finest one). 
Then, it is reconstructed with a dual frame type matrix 
ip, columns of this dual wavelet frames isxp d rn . The 
wavelet coefficients are; 

c(d,m ) = {y.ipd.m} = 4> y (d,m) 


The wavelet transform separates a low frequency 
image y ; projected over the low-frequency scaling 
filters ipi(d, m)& a high-frequency image y h projected 
over the finest scale wavelets in three directions 


ip y (h, m). 

&yn = IL1 


Vi = ^ c(l, m) ipi - 


mEG 

c(h,m) xp Km 


The low frequency image has little aliasing & can, 
thus, be precisely interpolated with a cubic spline 
interpolator. Detailed process is; 

Step 1: Computes a 1-D interpolation in the direction. 
We consider all lines of angle that intersect original 
image samples (crosses in Fig. 5) & we compute mid¬ 
points (circles) between image samples (crosses), with 
a cubic spline interpolation. This operation 
oversamples by a factor two either the image rows, or 
the image columns, or the diagonals of angle. The 
missing coefficients are shown as squares in Fig. 4.1. 

Step 2: Calculation of new samples or dots with a 
cubic spline interpolation along these oversampled 
rows, columns or diagonals. This interpolation 
introduces little aliasing because of the oversampling 
provided by the previous step. The positions of these 
new samples (dots) are chosen so that any missing 
coefficient (square) is a mid-point between two dots 
on a line of angle. 



Step 3: computes missing samples (squares) with a 
cubic spline linear interpolation along the direction 
from the previously calculated new samples (dots). 
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Figure 5: Directional interpolation 


For every single angle, application of directional 
interpolator is performed for the block of wavelet 
components if the directional regularity factor is less 
in that block. Such regularization is very much 
helpful, when the eigen values have significantly large 
variation, such that discrimination between regular & 
non-regular variations in the direction of angle, can be 
done. This is obtained by choosing rectangular blocks 
that are elongated in the direction of angle. Each 
block in the spatial neighborhood of is chosen to be 
identical in the three directions 1, 2, 3 & so on. 
Numerical experiments are performed with 20 angles, 
with blocks having a width of 2 pixels & a length 
between 6 & 12 pixels depending upon their 
orientation. Each block, thus, includes between 36 & 
72 wavelet coefficients over the 1, 2, 3 directions. 

An adaptive interpolation estimator by using block 
matching is obtained by estimating the mixing 
coefficients of a mixture model which minimizes the 
errors. The block matching technique performs the 
tasks of maxima finding & then energy update i.e. 
find the energy of blocks, if this energy is less than 
threshold than eliminate all blocks. 

This algorithm stops when there is no sufficiently 
energetic block compared to a precision threshold. 
The minimization is, also interpreted as an optimized 
approximation in orthogonal bundles computed over 
adapted blocks of wavelet coefficients. The adaptive 
wavelet interpolator is derived by taking IDWT of the 
resulting mixing coefficients. 

PROPOSED ALGORITHM 
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1. Take low resolution input imago. 

2. This subsampled image is decomposed with wavelet 
transform. 

3. Apply cubic spline interpolation for removal of 
aliasing of low frequency components. This process 
has following sub-steps: 

(i) First computes a 1-D interpolations in the direction. 

(it) Then computes new samples by Cubic Spline 
interpolation. 

(iii) After that missing samples are find out by again 
Cubic Spline interpolation. 

4. For each .angle, a directional interpolator is applied 
over a block of wavelet coefficients if the directional 
regularity factor is relatively small in the block. 

5. Apply adaptive mterpolaticn estimator by using 
block matching, for Maxima Finding & Energy 
Update. 

6. The adaptive wavelet interpolator is derived by 
taking inverse wavelet transform of the resulting 
mixing coefficients. 

7. This will result an image having more number of 
pixels, compared to the input LK. image, means the 
resultant image after application of above steps is a HR 
image. 

3. Calculate the performance parameters like PSNR. 
MSE etc. .and compare them with other techniques. 

M 5 • of Trend in 


5.1 Performance Parameters 

The performance parameters of image are MSE. 
PSNR, SSIM & many mm. But, for image super- 
resolution FSNR & SSEM are highly used. 

Peak Signal-to-Noise Ratio as a performance metric, 
which is measured in decibels (dB) for S-bit grayscale 

images as; PSNR = 101og 10 (^^) 

Where, the mean square error (MSE). defined as: 

Where: ||. || : is the Euclidean norm. 

A larger value of PSNR normally reflects the 
better performance for image analysis. The PSNR & 
MSE are generally used as the performance indices. 
But these are not so well matched to perceive visual 
quality of image directly. To resolve these problems, 
the structural similarity index (SSIM) [24] was 
proposed as another metric to compare images which 
correlates more appropriately with the human 
perception. SSIM basically maps two separate images 
into a single index in the interval [- 1, 1], where higher 
values are assigned to more similar pairs of images X 
& Y, calculated as; 

SSIM _ 


Take Low 
Resolution Input 
Image 


Perform DWT 
Decomposition 


Apply 1-D 
Interpolation 


Computes new 
samples Cubic 
Spline interpolation 


Where: fiY. aX2 & uY2 are the averages & variances 
of X & Y, aXY is the covariance between X & Y, both 
Cl &. C2 are predefined constants. 


5.2 

5.2.1 


Simulation Results 
TEST IMAGE LEAVES 


Apply adaptive interpolation estimator 
by using block matching, for Maxima 
Finding & Energy Update 


Apply directional 
interpolator on 
Wavelet Blocks 


Apply IDWT of the resulting 
mixing coefficients 


Reconstruction of High 
Resolution Image 


Computes missing 
samples Cubic 
Spline interpolation 


Performance Parameters 
Calculation of High 
Resolution Image 




** 


v 


Figure 6: Proposed Wavelet based Super-Resolution 
Flow Chart 

5. SIMULATION RESULTS 

The proposed method is tested on various standard 
images Lena; Baboon & Pepper are taken. All the 
input low-resolution images interpolated with factor 
2. The resolution of input image was 128 x 128. 
These input images are interpolated to the size of 512 
x 512.For quantitative comparison of results peak 
signal to noise ratio (PSNR) & SSIM is used. 


issss 



FIGURE 7: TEST IMAGE “LEAVES” 


HR ground truth 


LR Inputimage 
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Proposed Wavelet based Super-Resolution Method 32.30 dB 


Cubic spline: 31.24 dB 
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FIGURE 8: SIMULATION RESULT FOR TEST 
IMAGE “LEAVES” 
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5.2.2 TEST IMAGE HAT 



FIGURE 9: TEST IMAGE “HAT” 
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Proposed Wavelet based Super-Resolution Method 37.08 dB 
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FIGURE 10: SIMULATION RESULT FOR TEST 
IMAGE “HAT” 


5.2.3 TEST IMAGE MOUNTAIN LION 



FIGURE 11: TEST IMAGE “MOUNTAIN LION” 
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Proposed Wavelet based Super-Resolution Method 41.82 dB 
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FIGURE 12: SIMULATION RESULT FOR TEST 
IMAGE “MOUNTAIN LION” 


5.3 SIMULATION RESULT SUMMARY 

Table 1 shows the simulation results for various test 
images for PSNR and SSIM values. 


Test Images 

PSNR (dB) 

SSIM 

Leaves 

32.30 

0.9667 

Hat 

37.08 

0.9834 

Mountain Lion 

41.82 

0.9821 


TABLE 1: SIMULATION RESULTS SUMMARY 
PSNR PERFORMANCE 

■ Leaves ■ Hat = Mountain Lion 

45 
40 

1 35 

30 

£ 25 

20 
15 
10 
5 
0 



SSIM Performance 

0.985 



■ Leaves ■ Hat ■ Mountain Lion 


5.4 RESULT COMPARISON 

The PSNR and SSIM values with proposed algorithm 
has been compared with [1], Results shows our 
method is better than all existing techniques. 


Methods \ 

Leaves 

Mountain Lion 

Hat 

PNSR (dB) 

SSIM 

PNSR (dB) 

SSIM 

PNSR (dB) 

SSIM 

SCSR 

19.21 

0.6771 

25.28 

0.6388 

26.29 

0.79 

CCSR 

19.24 

0.6712 

25.33 

0.6424 

26.31 

0.7885 

AS-CSR 

19.25 

0.6722 

25.34 

0.6432 

26.32 

0.7894 

TV 

24.58 

0.8878 

27.53 

0.7076 

29.19 

0.8569 

Softcut 

24.34 

0.8372 

27.96 

0.6904 

28.68 

0.8389 

SR-CNN 

24.1 

0.8125 

28.66 

0.7441 

27.82 

0.8013 

ASR-SL [1] 

24.6 

0.8621 

28.9 

0.7588 

29.93 

0.8433 

Proposed Work 

32.3 

0.9667 

41.82 

0.9821 

37.08 

0.9834 


TABLE 2: SIMULATION RESULT 
COMPARISON WITH [1] 


6. CONCLUSION 

The proposed wavelet based interpolation method 
outperforms all other existing methods for single 
image super resolution. The proposed method has 7.7 
dB improvement in PSNR compared with Adaptive 
sparse representation and self-learning ASR-SL [1] 
for test image Leaves, 12.92 dB improvement for test 
image Mountain Lion & 7.15 dB improvement for test 
image Hat compared with ASR-SL [1], Similarly, 
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12% improvement in SSIM for test image Leaves 
compared with [1], 29% improvement in SSIM for 
test image Mountain Lion compared with [1] & 17% 
improvement in SSIM for test image Hat compared 
with [1], 
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